(12) INTERNATIONAL APPLICATION PUBLISHED UNDER THE PATENT COOPERATION TREATY (PCT) 



(19) World Intellectual Property Organization 
International Bureau 

(43) International Publication Date 
14 December 2000 (14.12.2000) 




PCT 



i urn unin u uiio 1111 mi i y iu nm mi bid hid in uim an nt m 

(10) International Publication Number 

WO 00/76147 Al 



(51) International Patent Classification 7 : H04L 12/56, 
H04Q 11/04 

(21) International Application Number: PCTAJSOQ/14935 

(22) International Filing Date: 1 June 2000 (01.06.2000) 



(25) Filing Language: 



English 



(26) Publication Language: English 
(30) Priority Data: 



09/324,948 



3 June 1999 (03.06.1999) US 



(71) Applicant: FUJITSU NETWORK COMMUNI- 
CATIONS, INC. [US/US]; 2801 Telecom Parkway, 
Richardson, TX 75082 (US). 

(72) Inventors: SMITH, Alexander; 21 17 McCoy Road, Car- 
roUton, TX 75006 (US). SHINBASHI, Masahiro; 5-16-7, 



Nakanoshima, Tama-ku, Kawasaki, Kanagawa 214-0012 
(JP). QIAN, Edward; 4413 Stromboli Drive, Piano, TX 
75093 (US). MIECZKOWSKI, Daniel, Joseph; 1214 
Newberry Drive, Allen, TX 75013 (US). CHEN, David; 
3912 Evesham Drive, Piano, TX 75025 (US). 

(74) Agent: LOOMIS, Timothy, F.; Law Offices of Timothy 
F. Loomis, 2932 Hagen Drive, Piano, TX 75025 (US). 

(81) Designated States (national): AE, AL, AM, AT, AU. AZ, 
BA, BB, BG, BR, BY, CA, CH, CN, CR, CU, CZ, DE, DK, 
DM, EE, ES, FI. GB, GD, GE, GH, GM, HR, HU, ID, JL, 
IN, IS, JP, KE, KG, KP, KR, KZ, LC, LK, LR, LS, LT, LU, 
LV, MA, MD, MG, MK, MN, MW, MX, NO, NZ, PL, PT, 
RO, RU, SD, SE, SG, SI, SK, SL, TJ, TM, TR, TT, TZ, UA, 
UG,UZ,VN, YU,ZA,ZW. 

(84) Designated States (regional): ARIPO patent (GH, GM, 
KE, LS, MW, MZ, SD, SL, SZ, TZ, UG, ZW), Eurasian 
patent (AM, AZ, BY, KG, KZ, MD, RU, TJ, TM), European 

[Continued on next page] 



(54) Title: SWITCHING REDUNDANCY CONTROL 



NO 



O 



23 



MBVm 
CARD 

M 



sa 



22^ 



STS SF 



29 













25 

Epj] 

26 




ATM SF 




16 
17 




if 








Ifl 

if 

lm) 

vt sr 




[S] 
18 

19 










STS SF 







52 ; 



(57) Abstract: An apparatus and method for switching re- 
dundancy control which provides fast switching from a mal- 
functioning component to a redundant component with mini- 
mum data flow interruption for both transmitted and received 
data. The redundancy control system having an APS (Au- 
tomatic Switching Protection) Hub, at least a working and a 
redundant tributary card, a bridge to provide identical traf- 
fic to the working and redundant tributary cards, a working 
and a redundant STM switching fabric, selectors within the 
working and redundant STM switching fabrics for selecting 
the traffic from the working tributary card to further process, 
a working and a redundant ATM switching fabric, a working 
and a redundant ATM processor and ATM selectors for se- 
lecting traffic needing cell switching from the working STM 
switching fabric to process further. The system is capable of 
monitoring itself to detect failures and the APS Hub is out- 
fitted so as to become aware of detected failures and initiate 
a switch in the appropriate selectors or ATM selectors so as 
to change the traffic being further processed from the failed 
working component to the redundant component. 
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SWITCHING REDUNDANCY CONTROL 

The present invention relates generally to a switching 
redundancy control method and system for providing fast switching from a 
malfunctioning working component to a redundant component with 
5 minimum data flow interruption for both transmitted and received data. 



BACKGROUND OF THE INVENTION 
Telecommunication service providers today face an ever 
increasing amount competition. Competitive local exchange carriers and 
10 traditional long distance carriers are entering the local telecommunications 

services market, while the Regional Bell Operating Companies are 
attempting to enter the long distance telecommunications services market. 
This dramatic increase in competition makes it imperative that the quality 
of service provided by a telecommunication service provider be extremely 
15 high. If telecommunications customers finds their service interrupted, it is 

very easy for them to switch to another service provider. 

Although the quality of manufacture of telecommunications 
equipment is increasing, along with better manufacturing techniques and 
materials technologies, failures still to do occur on components within 
20 telecommunications systems. Because of the increased competition in 

the service provider market, it is very important that the service 
interruptions caused by failures are minimized in terms of data loss or 
delay. Providing redundancy within telecommunications equipment is one 
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way to address these concerns. 

Redundancy within telecommunications equipment has 
been provided in the past. However, typically the redundancy control 
systems are complex and/or are not quick enough to switch between a 
5 working component with a failure and a redundant component for today's 

heavy data traffic loads and high data rates. 

Thus, a need has arisen for a non-complex, yet quick, 
switching redundancy control method and apparatus. 



10 SUMMARY OF THE INVENTION 

The present invention provides an apparatus and method for 
switching redundancy control which provides fast switching from a 
malfunctioning component to a redundant component with minimum data 
flow interruption for both transmitted and received data. The invention 

15 does so by providing an APS (Automatic Switching Protection) Hub, at 

least a working and a redundant tributary card, a bridge to provide 
identical traffic to the working and redundant tributary cards, a working 
and a redundant STM switching fabric, selectors within the working and 
redundant STM switching fabrics for selecting the traffic from the working 

20 tributary card to further process, a working and a redundant ATM 

switching fabric, a working and a redundant ATM processor and ATM 
selectors for selecting traffic needing cell switching from the working STM 
switching fabric to process further. Other data switching fabrics and 

2 
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processors, such as frame relay, could also be used instead of, or in 
addition to, ATM. The system is capable of monitoring itself to detect 
failures and the APS Hub is outfitted so as to become aware of detected 
failures and initiate a switch in the appropriate selectors or ATM selectors 
5 so as to change the traffic being further processed from the failed working 

component to the redundant component. 

Thus, it is an object of the present invention to provide a 
non-complex system and method for fast switching between working and 
redundant components in a telecommunications network element when a 
10 fault occurs on the working component. 

It is a further object of the present invention to provide for 
the fast switching between a working and redundant tributary card when 
the working card is experiencing faults so as to minimize traffic loss. 

It is a further object of the present invention to provide for 
15 the fast switching between a working and redundant STS switching fabric 

when the working fabric is experiencing faults so as to minimize traffic 
loss. 

It is a further object of the present invention to provide for 
the fast switching between a working and redundant VT switching fabric 
20 when the working fabric is experiencing faults so as to minimize traffic 

loss. 

It is a further object of the present invention to provide for 
the fast switching between a working and redundant ATM processor card 

3 
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when the Working card is experiencing faults so as to minimize traffic loss. 

It is a further object of the present invention to provide for 
the fast switching between a working and redundant ATM switching fabric 
when the working fabric is experiencing faults so as to minimize traffic 
loss. 

BRIEF DESCRIPTION OF THE DRAWINGS 

These and other objects and advantages of the present 
invention will become apparent and more readily appreciated by reference 
to the description of the preferred embodiments, taken in conjunction with 
the accompanying drawings, of which: 

Fig. 1 is a block diagram of a network element according to 
an embodiment of the present invention; 

Fig. 2 is a block diagram of a redundancy control system 
according to an embodiment of the present invention; 

Fig. 3 is a flow chart of a redundancy control method for 
tributary cards according to an embodiment of the present invention; 

Fig. 4 is a flow chart of a redundancy control method for 
switching fabrics according to another embodiment of the present 
invention; 

Fig. 5 is a block diagram of a redundancy control system 
according to another embodiment of the present invention. 

Fig. 6 is a flow chart of a redundancy control method for 
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initialization of ATM processor cards and ATM switching fabrics according 
to an embodiment of the present invention; 

Fig. 7 is a flow chart of a redundancy control method for 
ATM processor cards and ATM switching fabrics according to another 
5 embodiment of the present invention; 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 

The present invention will be better understood by reference 
to the accompanying drawings. 
10 Fig. 1 depicts a network element 1 1 having a redundancy 

control system of an embodiment of the present invention. Network 
element 1 1 may be of the type discussed in co-pending application Serial 

No. , entitled "Dialable Data Services/TDM Bandwidth 

Management". Preferably, redundancy is provided at each level through 
15 which user traffic flows. 

To support operation in a redundant mode, user traffic 
entering network element 1 1 through line 60 is bridged by bridge 5 to 
redundant tributary cards 12 and 13. This bridging may be accomplished 
in several known ways that would permit operation of network element 1 1 
20 in both a redundant mode and a non-redundant mode. One 

implementation would include backplane access from the rear of tributary 
cards 12 and 13 for operation in both modes. Another option would 
include rear access for redundant mode and front access for non- 

5 
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redundantmode. This approach might require that two separate types 
tributary cards be designed though. A third approach could include a 
backplane that does not support redundant mode but instead utilizes a 
special designed Y-cable for providing bridging. Other specific 
implementations may exist as well. Tributary cards 12 and 13 may be 
LAN cards, frame relay cards, POTs cards or any other type of tributary or 
line card. 

When network element 1 1 is operating in a redundant mode, 
one of tributary cards 12 and 13 is designated to be working (tributary 
card 12, for instance) and the other is designated to be redundant 
(tributary card 13, for instance). Preferably, tributary cards 12 and 13 are 
located adjacent to one another to minimize the distance between the 
cards and thereby minimize the time required for a switch-over when 
working tributary card 12 experiences problems. 

STS switching fabrics 21 and 22 both receive processed 
traffic from tributary cards 12 and 13 and are capable of switching STS-n 
level signals. In a redundant mode, one of STS switching fabrics 21 and 
22 is designated working (STS switching fabric 21 for instance) and the 
other is designated redundant (STS switching fabric 22 for instance). 
Although STS switching fabrics 21 and 22 receive processed traffic from 
both tributary cards 12 and 13, they only select traffic from the working 
tributary card (in this case, tributary card 12) for further transmission. 
Similarly, in the other direction, traffic from both STS switching fabrics 21 
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and 22 is "bridged to both tributary cards 12 and 13, while only working 
tributary card 12 f onwards traffic to line 60. 

Also provided in network element 11 are VT switching 
fabrics 31 and 32, one of VT switching fabrics 31 and 32 being designated 
5 as working (VT switching fabric 31 for instance) and one being designated 

as redundant (VT switching fabric 32 for instance). VT switching fabrics 
31 and 32 are capable of switching virtual tributary (VT-n) signals. ATM 
switching fabrics 41 and 42 are also provided, one of ATM switching 
fabrics 41 and 42 being designated as working (ATM switching fabric 41 

10 for instance) and one being designated as redundant (ATM switching 

fabric 42 for instance). ATM switching fabrics 41 and 42 are capable of 
ATM cell switching. VT switching fabrics 31 and 32 receive traffic from 
STS switching fabrics 21 and 22 that has been designated as needing VT 
switching. Likewise, VT switching fabrics 31 and 32 provide VT switched 

15 traffic to STS switching fabrics 21 and 22. ATM switching fabrics 41 and 

42 receive traffic from STS switching fabrics 21 and 22 that are in need of 
cell switching and provide cell switched traffic to STS switching fabrics 21 
and 22. 

Aggregate card 51 receives traffic from STS switching 
20 fabrics 21 and 22. Aggregate card 51 may be an OC-n card, for example. 

Aggregate card 51 then processes only traffic from active STS switching 
fabric 21 for transmission out of network element 1 1 through line 61 . 
Incoming traffic from line 61 is provided to both STS switching fabrics 21 
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and 22. If should be realized that a redundant aggregate card could be 
provided also. 

Operation of APS (Automatic Protection Switching) 
distribution blocks, such as 6, 7, 24, 26, 28, 30, 17, 19 and 53, and APS 
5 selection blocks, such as 8, 9, 23, 25, 33, 34, 43, 44, 45, 46, 35, 36, 27, 

29, 16, 18 and 52, will be described by way of example in reference to 
Fig. 2. 

Fig. 2 shows the details of the redundancy control system of 
an embodiment of the present invention as it relates to traffic flowing 
10 between the tributary cards and the STS switching fabric. 

Traffic flowing to tributary cards 12 and 13 from STS 
switching fabrics 21 and 22 is bridged to both tributary cards 12 and 13 by 
APS (Automatic Protection Switching) distribution blocks 24 and 26 in 
STS switching fabrics 21 and 22, respectively. This is accomplished 
15 through logic and/or software within APS distribution blocks 24 and 26. 

Design of such bridging functions would be within the capabilities of one 
skilled in the art. 

The STS switching fabrics 21 and 22 receive traffic from 
both tributary cards 12 and 13 through APS selectors 23 and 25 
20 respectively. APS selectors 23 and 25 select traffic received from only 

working tributary card 12 to pass on. This may be accomplished through 
logic and/or software within APS selectors 23 and 25. 

Tributary cards 12 and 13 should preferably be designed to 

8 
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detect hardware/software failures. Some methods of doing so would 
include designing parity checks on address and data buses, providing 
ASICs 2 and 3 with the capability to self check, or providing diagnostic 
software that periodically runs diagnostics when ports are not actively 
5 transmitting or receiving traffic. Other methods may exist as well. Design 

of such features would be within the capabilities of one skilled in the art. 

The two tributary cards 12 and 13 should appear as one 
card to other telecommunications network elements. If tributary cards 12 
and 13 are LAN cards, for instance, they should have the same Media 
10 Access Controller (MAC) address. To achieve this, network element CPU 

76 reads the MAC address from non-volatile RAM 18 in working tributary 
card 12 and writes it to redundant tributary card 13 into non-volatile RAM 
19. 

Preferably, tributary cards 12 and 13 both are active at the 
15 same time. That means both would actively process any traffic received 

from either direction. This will assist in minimizing the time it takes 
redundant tributary card 13 to become working in the event of a problem 
with working tributary card 12, since switch-over would basically amount to 
only flipping a switch in APS selectors 23 and 25 and relays 14 and 15 on 
20 the transmit path of tributary cards 12 and 13 as discussed below with 

regard to Fig. 3. Although redundant tributary card 13 would be actively 
processing data, its data would be thrown away while it remained in the 
redundant mode at the APS selectors 23 and 25. 
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Operation of relays 14 and 15 is now described. Tributary 
cards 12 and 13 have relays 14 and 15, respectively, in series with the 
path of traffic flowing to bridge 5 out to line 60. During operation of 
network element 1 1 , relay 14 of working tributary card 12 will be closed, 
5 allowing traffic to flow to bridge 5, while relay 15 of redundant tributary 

card 13 will be opened, prohibiting traffic from flowing to bridge 5. That 
way, only traffic from the working card is passed onto line 60. Should 
tributary card 12 experience problems and tributary card 13 become the 
working card, then relay 14 will be opened and relay 15 will be closed so 
10 that only traffic from tributary card 1 3 would flow through bridge 5 to line 

60. 

APS selectors 8, 9, 33, 34, 35, 36, 43, 44, 45, 46, 27, 29, 
16, 18 and 52 shown in Fig. 1, perform the same function for the signals 
provided to them as do APS selectors 23 and 25 described above. APS 

15 distributors 6, 7, 28, 30, 17, 19 and 53, shown in Fig. 1, perform the same 

function for the signals provided to them as do APS distributors 24 and 26 
described above. They may be implemented in the same fashion or in a 
different fashion by one skilled in the art. For simplicity purposes, 
separate description of their operation will not be provided. 

20 Figure 3 depicts the process undertaken by network element 

1 1 in the redundancy control method according to an embodiment of the 
present invention. In this embodiment, tributary cards 12 and 13 are LAN 
cards and are provisionable by a network operator (not shown) to act in a 

10 
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non-redundant mode or a redundant mode. 

In step 100, a network operator provisions tributary cards 12 
and 13 for a redundancy mode. Once the network operator has selected 
tributary cards 12 and 13 to operate in a redundancy mode, the network 
element CPU 76 reads the MAC address of working tributary card 12 and 
writes it to redundant tributary card 13 in step 105. Preferably, the MAC 
address is written into non-volatile RAM. In step 110, network element 
CPU 76 then notifies tributary card 13 that is a redundant and opens relay 
15 on tributary card 13. In step 115, when working tributary card 12 has 
detected the presence of a failure on itself that necessitates a switch-over 
to redundant tributary card 13, it informs APS Hub 71 of the unit failure on 
serial point-to-point overhead link 85 and opens relay 14 in its transmit 
path to line 60 so as to cease transmitting to line 60. APS Hub 71 then 
switches APS selectors 23 and 25 in STS switching fabrics 21 and 22, 
respectively, so the traffic to be processed by STS switching fabrics 21 
and 22 will now be from tributary card 13 and informs tributary card 13 
through parallel bus 81 that it is now the working card in step 120. In step 
125, relay 15 in new working card 13 then closes to allow traffic to be 
transmitted through bridge 5 onto line 60. 

As discussed above, STS switching fabrics 21 and 22 and 
VT switching fabrics 31 and 32 are set up in a redundancy mode. Fig. 4 
shows a criteria for switch-over between working STS switching fabric 21 
and redundant STS switching fabric 22 and between working VT switching 

11 
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fabric 31 and redundant VT switching fabric 32 according to an 
embodiment of the present invention. This may be implemented in 
software in network element 1 1 . In step 200, both working switching 
fabric and redundant switching fabric are monitored for frame errors. This 
5 monitoring can be done in much the same fashion as with tributary cards 

12 and 13 described above. In step 205, a decision is made as to 
whether or not there have been a predetermined number of consecutively 
errored frames in the working switching fabric. The predetermined 
number could be any integer, such as three. Alternatively, the system 

10 could be set up so that it looks for a predetermined percentage of errored 

frames after detecting a first errored frame or a predetermined number of 
errored frames within a preset time. 

If the predetermined number of consecutive errored frames 
has not been reached, step 200 is repeated. If the predetermined number 

15 of consecutively errored frames has been reached, working switching 

fabric notifies APS Hub 71 through serial point-to-point overhead link 85 in 
step 207. APS Hub 71 then checks with the redundant switching fabric 
through serial point-to-point overhead link 85 to determine whether the 
redundant switching fabric is experiencing frame errors in step 210. The 

20 same or different method and criteria can be applied to determine if the 

redundant switching fabric is experiencing frame errors. If it is, step 200 is 
repeated. If it is not, a switch-over is initiated in step 215. In the case that 
STS switching fabrics 21 and 22 are being switched, APS Hub 71 

12 
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switches APS selectors 8 and 9 in tributary cards 12 and 13, respectively, 
so that the traffic to be processed by tributary cards 12 and 13 from will 
now be from STS switching fabric 22 and informs STS switching fabric 22 
through parallel bus 81 that it is now the working switching fabric. In the 
5 case that VT switching fabrics 31 and 32 are being switched, APS Hub 71 

switches APS distributors 24 and 26 in STS switching fabric 21 and 22, 
respectively, so the traffic passed on by STS switching fabrics 21 and 22 
will now be from VT switching fabric 22 and informs VT switching fabric 22 
through parallel bus 81 that it is now the working switching fabric. 
10 Preferably, a switch-over will not be immediately reversible. This will 

prevent bouncing between the two fabrics when noisy traffic conditions 
exist. 

Redundancy control for the ATM switching fabrics may be 
handled as shown in Fig. 5. As shown in Fig. 5, network element 1 1 
15 contains ATM switching fabrics 41 and 42 and ATM processor cards 45 

and 46. The ATM processors found on ATM processor cards 45 and 46 
could alternatively reside on the same card as the ATM switching fabrics 
41 and 42 respectively. For purposes of redundancy control, under an 
embodiment of the present invention, ATM switching fabric 41 and ATM 
20 processor card 45 are handled as a single unit in terms of redundant 

switching protection. The same is true for ATM switching fabric 42 and 
ATM processor card 46. 

Each ATM processor card 45 and 46 has a dedicated 

13 
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connection 65a and 65b, respectively, to its respective ATM switching 
fabric card's CPU for sending and receiving signaling and messages, such 
as PNNI and ILMI messages. Such a connection is preferably through a 
AAL5 SAR device (not shown). Each ATM processor card 45 and 46 is 
also connected to its respective ATM switching fabric card 41 and 42 
through a respective control bus 66a and 66b. These control busses 66a 
and 66b are used to provide access to ATM switching fabric registers (not 
shown) and for receiving interrupts from ATM switching fabrics 41 and 42. 
Software on ATM processor cards 45 and 46 uses a safe read and safe 
write function to read and write to ATM switching fabric registers. Each 
ATM processor card 45 and 46 is connected to network element CPU 76 
via a TCP/IP connection over HDLC link 91. This connection permits the 
downloading of provisioned ATM databases to the ATM processor cards 
45 and 46. Programing of connection tables in the switching fabric can be 
done by ATM processor cards 45 and 46 either through inband control 
cells through dedicated connections 65a and 65b CPU port or through 
commands through control busses 66a and 66b, respectively. 

Two sets of parallel bus registers 77a and 77b to which the 
ATM processor cards 45 and 46 and APS Hub 71 write to and read from 
exist - one for each set of ATM processor cards/ATM switching fabric 
cards. Sets of registers 77a and 77b each include an ATM processor 
card present, ATM switching fabric card present, activity request to ATM 
processor card, and ATM processor card status register. 

14 
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ATM processor cards 45 and 46 and network element CPU 
76 are connected by HDLC link 91. ATM processor card kernel software 
provides a pNA software layer on top of HDLC link 91 for TCP/IP stack 
functionality. 

Figs. 6 and 7 depict a redundancy control method according 
to an embodiment of the present invention for handling ATM switching 
fabrics and ATM processor cards. 

In Fig. 6, the initialization sequence upon booting up 
according to an embodiment of the present invention is shown. In step 
300, APS Hub 71 decides which of ATM processor cards 45 and 46 will 
be working and updates registers 77a and 77b via parallel bus 81 . When 
registers 77a and 77b are updated by the APS Hub 71 , the respective 
ATM processor cards 45 and 46 will get an interrupt over parallel bus 81 
and read their respective registers 77a and 77b. In step 310, ATM 
processor cards 45 and 46 then inform APS Hub 71 of their state by 
updating their respective status registers within registers 77a and 77b. 
APS Hub 71 checks the status of the status registers within 77a and 77b 
to ensure ATM processor cards 45 and 46 have accepted their 
assignments. States that can be stored in status registers within 77a and 
77b include both nonfunctional and functional states. Functional states 
include redundant, working and in a download. The nonfunctional states 
include diagnostics, ATM switching fabric diagnostics, booting and reset. 
The APS Hub 71 can initiate interrupts due to manual switching, initial 

15 
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provision or fault detection. 

In step 320, ATM processor cards 45 and 46 initiate TCP/IP 
connections to network element CPU's 75 IP address over HDLC link 91 
through known socket ports. There are separate known socket ports (not 
5 shown) for the working and redundant state of the ATM processor cards. 

Network element CPU's 75 server software listens to these two socket 
ports. The working ATM processor card 45 connects to the active socket 
port and* redundant ATM processor card 46 connects to the inactive 
socket port. In step 330, upon the connection, the ATM processor cards 

10 45 and 46 send a database download request message to network 

element CPU 75. This message preferably includes the ATM processor 
card's software version, activity state, database version, the latest IPP 
transaction ID and time. In step 340, it is determined if a database or a 
software download is needed. If so, in step 350 it is checked to determine 

15 if the card needing the download is a redundant. If the card is a 

redundant, the download occurs in step 360. If not, in step 370, the APS 
Hub can be notified. When the software download is completed, in step 
380, the ATM processor card 45 or 46 informs network element CPU 75 
whether or not the download was successful and then restarts itself. 

20 When IPP messages are needed to be sent by network 

element CPU to ATM processor cards 45 and 46, they are sent first to 
working ATM processor card 45. Once working ATM processor card 45 
returns a success response, the message is forwarded to redundant ATM 

16 
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processor card 46 by network element CPU 75. It is not necessary that 
the redundant ATM processor card 46 receive IPP messages from 
network element CPU 75. Instead, the working ATM processor card 45 
can be responsible for sending IPP messages to the redundant ATM 
5 processor card 46. However, this would require additional software in the 

working ATM processor card 45 to recreate IPP messages from its 
database and send them to the redundant ATM processor card 46 when a 
new redundant ATM processor card 46 is inserted. 

Fig. 7 shows redundancy control method according to an 

10 embodiment of the present invention for handling ATM switching fabrics 

and ATM processor cards when faults are detected. 

Each ATM processor card 45 and 46 detect faults when they 
occur, such as LCD alarms. In step 400 such a fault is detected. Upon 
detection of an alarm, ATM processor cards 45 and 46 report the alarm to 

15 APS Hub 71 in step 405. When APS Hub 71 receives a fault interrupt 

from ATM processor card 45 or 46, it realizes there is an ATM processor 
card failure or an ATM switching fabric failure. In step 41 0, APS Hub 71 
retrieves the alarms from the working ATM processor card's 45 parallel" 
bus registers 77a. Preferably, VP protection is performed in both ATM 

20 processor cards 45 and 46. The reason for the fault can be a stored in 

parallel bus register 77a or 77b or, alternatively, software residing on the 
ATM processor card could issue an interrupt with the reason for the fault. 
A number of faults can be used including: software watch dog timeout; 

17 
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card pullout; power-up restart; front panel reset; ATM processor card 
memory bus error; illegal instruction; PCI bus error; Utopia parity error; 
ATM switching fabric memory parity error; ATM switching fabric memory 
bus error; software bus error; ATM processor card insert; ATM processor 
card pull-out; ATM switching fabric insert; and ATM switching fabric pull- 
out. 

In step 415, a APS Hub 71 initiates a switch-over. When a 
switch-over occurs, in step 420, each of ATM processor cards 45 and 46 
shuts down the TCP/IP connection and reconnects with reversed socket 
ports so that the new working ATM processor card 46 is now connected to 
the working socket port and the new redundant ATM processor card 45 is 
connected to the redundant socket port. The ATM processor cards 45 
and 46 will also each shut down its connection if a reset/fault trigger 
causes the transition to a nonfunctional state. 

When redundant ATM processor card 46 goes from the 
redundant state to the working state in step 425, it enables the SAR 
signaling AAL5 connections. Restart messages are sent to all the 
UNI/NNI interfaces requesting the peers to restart all the active UNI/NNI 
calls. The SVC entries in the database and in the ATM switching fabric 
are then cleared before accepting any new calls. 

In ATM communications, duplicate cells cannot be 
transmitted by a switch and cell ordering must be maintained. In order to 
achieve this, the redundant ATM processor card 46 will disable its switch 

18 



WO 00/76147 



PCT/US00/14935 



ports for both receiving and transmitting. This way, no cells can be 
queued in. Thus in step 430, when the redundant ATM processor card 46 
becomes working, it enables the switch ports and when the working ATM 
processor card 45 becomes redundant, it flushes its buffers and disables 
its switch ports. 

Although the preferred embodiments of the present 
invention have been described and illustrated in detail, it will be evident to 
those skilled in the art that various modifications and changes may be 
made thereto without departing from the spirit and scope of the invention 
as set forth in the appended claims and equivalents thereof. 
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We Claim: 

1 . A redundancy control system comprising: 

a plurality of tributary cards, each of said cards being outfitted so as 
to detect failures and one of said plurality of tributary cards being a 
5 working tributary card and another of said plurality of tributary cards being 

a redundant tributary card; 

a bridge, said bridge being outfitted so as to provide identical traffic 
to said working and redundant tributary cards; 

a working STS switching fabric, said working STS switching fabric 
10 receiving data frames from said working and redundant tributary cards, 

said working STS switching fabric comprising a first selector, said first 
selector being outfitted so as to select received traffic from one of said 
working and redundant tributary cards to process; 

a redundant STS switching fabric, said redundant STS switching 
15 fabric also receiving said data frames from said card, said redundant STS 

switching fabric comprising a second selector, said second selector being 
outfitted so as to select received traffic from one of said working and 
redundant tributary cards to process; 

a plurality of ATM switching fabric cards, said plurality of ATM 
20 switching fabric cards receiving data frames from said working and 

redundant STS switching fabrics; 

a plurality of ATM processor cards, one of said ATM switching 
fabric cards and one of said ATM processor cards being grouped to form 
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a first redundancy group and another of said ATM switching fabric cards 
and another of said ATM processor cards being grouped to form a second 
redundancy group; and 

an APS hub, said APS hub being outfitted so as to become aware 
5 of detected failures on said plurality of tributary cards and switch said 

selector so as to select received data frames from said redundant tributary 
card upon becoming aware of a detected failure on said working tributary 
card, said APS hub further being outfitted so as to select one of said first 
redundancy group and said second redundancy group to be working and 
10 another of said first redundancy group and said second redundancy group 

to be redundant. 

2. A redundancy control system comprising: 

a plurality of cards, each of said cards being outfitted so as to 
15 detect failures, one of said plurality of cards being a working card and 

another of said plurality of cards being a redundant card; 

a bridge, said bridge being outfitted so as to provide identical traffic 
to said working and redundant of cards; 

a selector, said selector being outfitted so as to receive traffic from 
20 said plurality of cards and select received traffic from one of said plurality 

of cards to process; 

an APS hub, said APS hub being outfitted so as to become aware 
of detected failures on said plurality of cards; 
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wherein upon becoming aware of a detected failure on said working 
card, said APS hub switches said selector so as to select received traffic 
from said redundant card for processing. 

3. A redundancy control system as in claim 2, wherein upon becoming 
aware of said detected failure on said working card, said APS hub also 
informs said redundant card that it is now a working card. 

4. A redundancy control system as in claim 2, wherein said APS hub 
communicates with said plurality of cards over an overhead serial link. 

5. A redundancy control system as in claim 2, wherein said failures 
include hardware failures and software failures. 

6. A redundancy control system as in claim 2, wherein said plurality of 
cards perform parity checks to detect failures. 

7. A redundancy control system as in claim 2, wherein diagnostic 
tests are run on said plurality of cards when said cards are not actively 
transmitting or receiving data. 

8. A redundancy control system as in claim 2, wherein said plurality of 
cards each comprise an ASIC that is capable of checking for failures on 
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its respective card and said plurality of cards inform said APS Hub of 
failures. 

9. A redundancy control system as in claim 2, wherein said plurality of 
cards are tributary cards. 

10. A redundancy control system as in claim 2, wherein said plurality of 
cards are LAN cards. 

11. A redundancy control system as in claim 10, wherein said active 
and redundant cards have identical MAC addresses. 

12. A redundancy control system as in claim 2, wherein said bridge 
comprises a Y-cable. 

13. A redundancy control system as in claim 2, wherein said bridge 
comprises at least a portion of a backplane. 

14. A redundancy control system as in claim 2, wherein both said 
working and redundant cards actively process traffic received. 

15. A method of redundancy control, comprising the steps of: 
provisioning a first and a second card so that one of said first and 
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second cards is a working card and one is a redundant card; 

reading a MAC address from said first card; 

writing said MAC address to said second card; 

receiving data from said working card; 
5 detecting a failure on said working card; 

after detecting said failure, switching packet data received, so that 
said packet data received is received from said redundant card rather than 
from said working card. 

10 16. A method as in claim 15, wherein said writing said MAC address 

step comprises writing said MAC address to non-volatile RAM. 

17. A method as in claim 15, further comprising the step of opening a 
relay on said redundant card at or about a time of said writing said MAC 

15 address step. 

18. A method as in claim 17, further comprising the steps of informing 
said redundant card that it is now a working card, and closing said relay. 

20 19. A method as in claim 15, further comprising the step of opening a 

relay on said working card at or about a time of said detecting a failure 
step. 
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20. A method as in claim 15, wherein both a working and a redundant 
STS switching fabric receive said data from said working card. 

21 . A redundancy control system, comprising: 
a card; 

a working STS switching fabric, said working STS switching fabric 
receiving traffic frames from said card; 

a redundant STS switching fabric, said redundant STS switching 
fabric also receiving said traffic frames from said card; 

wherein after processing a predetermined number of consecutive 
traffic frames containing detected errors, said redundant STS switching 
fabric and said working STS switching fabric are switched over, so that 
said working STS switching fabric becomes redundant and said redundant 
STS switching fabric becomes working. 

22. A redundancy control system as in claim 21 , wherein said 
switch-over is not immediately reversible. 

23. A redundancy control system as in claim 21 , wherein said 
switch-over will not occur if errors in frames processed by said redundant 
STS switching fabric are also detected. 

24. A redundancy control system comprising: 
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a plurality of ATM switching fabric cards; 

a plurality of ATM processor cards, one of said ATM switching 
fabric cards and one of said ATM processor cards being grouped to form 
a first redundancy group and another of said ATM switching fabric cards 
5 and another of said ATM processor cards being grouped to form a second 

redundancy group; and 

an APS hub; 

wherein, one of said first redundancy group and said second 
redundancy group is working and another of said first redundancy group 
10 and said second redundancy group is redundant and wherein said APS 

hub selects which redundancy group is working. 

25. A redundancy control system as claimed in claim 24, further 
comprising a bus, said bus being coupled to said APS hub and said first 

15 and second redundancy groups, wherein said APS hub selects which 

redundancy group is working via sending a request over said bus. 

26. A redundancy control system as claimed in claim 25, wherein said 
bus is coupled to said first and second redundancy groups via said one of 

20 said ATM processor cards and said another of said ATM processor cards, 

respectively. 

27. A redundancy control system as claimed in claim 25, wherein said 
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ATM processor cards each convey a state to said APS hub via said bus. 

28. A redundancy control system as claimed in claim 27, further 
comprising a plurality of sets of registers. 

29. A redundancy control system as claimed in claim 28, further 
comprising a bus ASIC, said bus ASIC being outfitted so as to generate 
an interrupt to software on said ATM processor cards upon an update to a 
register within said plurality of sets of registers. 

30. A redundancy control system as claimed in claim 29, wherein each 
of said sets of registers stores data indicative of whether an ATM 
processing card is present in a particular slot. 

31. A redundancy control system as claimed in claim 29, wherein each 
of said sets of registers stores data indicative of whether an ATM 
switching fabric is present in a particular slot. 

32. A redundancy control system as claimed in claim 29, wherein each 
of said sets of registers is associated with one of said redundancy groups 
and stores data indicative of a request by said APS hub for a respective 
redundancy group to be working or redundant. 
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33. A redundancy control system as claimed in claim 29, wherein each 
of said sets of registers stores data indicative of a status of an associated 
ATM processing card. 

34. A redundancy control system as claimed in claim 25, further 
comprising a fault register containing an indication of a type of fault found 
in one of said redundancy groups. 

35. A redundancy control system as claimed in claim 24, wherein each 
of said first and second redundancy groups further comprises a control 
bus connecting said redundancy groups' respective ATM processing card 
to said redundancy groups' respective ATM switching fabric, said control 
bus permitting said respective ATM processing card to receive interrupts 
from said respective ATM switching fabric. 

36. A redundancy control system as claimed in claim 24, further 
comprising a link and a network element CPU, said link connecting said 
plurality of ATM processor cards to said network element CPU such that 
said plurality of ATM processor cards are capable of downloading an ATM 
database over said link from said network element CPU. 

37. A redundancy control system as claimed in claim 36, wherein said 
link is an HDLC link. 
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38. A redundancy control system as claimed in claim 24, wherein said 
ATM processor cards are capable of detecting faults within themselves 
and said ATM switching fabrics. 

5 39. A redundancy control system as claimed in claim 24, further 

comprising two interrupt lines, one of said interrupt lines connecting said 
first redundancy group to said APS hub and another of said interrupt lines 
connecting said second redundancy group to said APS hub, said two 
interrupt lines being outfitted so as to convey interrupts to said APS hub. 

10 

40. A redundancy control system as claimed in claim 39, wherein said 
interrupts include a software watchdog interrupt. 

41. A redundancy control system as claimed in claim 39, wherein said 
15 interrupts include a card pull out interrupt. 

42. A redundancy control system as claimed in claim 39, wherein said 
interrupts include a power up reset interrupt. 

20 43. A redundancy control system as claimed in claim 39, wherein said 

interrupts include a front panel reset interrupt 

44. A redundancy control system as claimed in claim 39, wherein said 
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interrupts include a ATM processor card memory bus error interrupt. 

45. A redundancy control system as claimed in claim 39, wherein said 
interrupts include an illegal instruction interrupt. 

46. A redundancy control system as claimed in claim 39, wherein said 
interrupts include a PCI bus interrupt. 

47. A redundancy control system as claimed in claim 39, wherein said 
interrupts include a Utopia parity error interrupt. 

48. A redundancy control system as claimed in claim 39, wherein said 
interrupts include a switching fabric memory parity error interrupt. 

49. A redundancy control system as claimed in claim 39, wherein said 
interrupts include a switching fabric memory bus error interrupt. 

50. A redundancy control system as claimed in claim 39, wherein said 
interrupts include a software bus error interrupt. 

51 . A redundancy control system as claimed in claim 39, wherein said 
interrupts include an ATM processor card insert interrupt. 
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52. A redundancy control system as claimed in claim 39, wherein said 
interrupts include an ATM processor card pull-out interrupt. 

53. A redundancy control system as claimed in claim 39, wherein said 
interrupts include an ATM switching fabric insert interrupt. 

54. A redundancy control system as claimed in claim 39, wherein said 
interrupts include an ATM switching fabric pull-out interrupt 

55. A method of redundancy control comprising the steps of: 
selecting a working and a redundant ATM processor; 
connecting said working and redundant ATM processor to a CPU 

via TCP/IP connections; 

determining if a download from said CPU is needed by one or both 
of said working and redundant ATM processor; 

if a download is needed by said redundant ATM processor, 
downloading; 

if a download is needed by said working ATM processor, not 
downloading until after it is no longer selected as working. 

56. A method of redundancy control as in claim 55, wherein said 
download is a new software version download. 
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57. A method of redundancy control as in claim 55, wherein said 
download is a database download. 

58. A method of redundancy control comprising: 

monitoring a working and redundant ATM processor and ATM 
switching fabric for faults; 

upon detection of a fault, switching-over said working and 
redundant ATM processor and ATM switching fabric so that said working 
ATM processor and ATM switching fabric become a new redundant ATM 
processor and ATM switching fabric and said redundant ATM processor 
and ATM switching fabric become a new working ATM processor and 
ATM switching fabric, 

wherein said working and redundant ATM processors disconnect 
TCP/IP connections to a CPU and reverse their connections, so that said 
working ATM processor is now connected to a redundant connection and 
said redundant ATM processor is now connected to a working connection. 

59. A method of redundancy control as claimed in claim 58, further 
comprising the step of said redundant ATM processor restarting UNI/NNI 
calls and clearing SVC entries upon being switched-over. 

60. A method of redundancy control as claimed in claim 59, further 
comprising the steps of said new working ATM processor enabling switch 
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ports on said new working ATM switching fabric and said new redundant 
ATM processor disabling switch ports on said new redundant ATM 
switching fabric. 



SUBSTITUTE SHEET (RULE 26) 



WO 00/76147 



PCT/US00/14935 




SUBSTITUTE SHEET (RULE 26) 



WO 00/76147 



PCT/US00/14935 




SUBSTITUTE SHEET (RULE 26) 



WO 00/76147 



PCT/US00/14935 



3/4 



100- 



105- 



110- 



1 15- 



120- 



125- 



PR0VISI0N LAN CARDS 
FOR REDUNDANCY 

l 



CPU 76 READS MAC 
ADDRESS OF WORKING CARD 
AND WRITES IT TO SPARE 



I 



CARD 13 NOTIFIED THAT IT 
IS SPARE, OPENS RE LAY 15 

I 



UPON A FAULT ON WORKING 
CARD 12, WORKING CARD 12 
NOTIFIES APS HUB 71 
AND OPENS RELAY 14 



APS HUB 71 SWITCHES APS 
SELECT 23 + 25 AND INFORMS 
CARD 13 IT IS NOW WORKING 

1 



CARD 13 CLOSES RELAY 15 



FIG. 3 




SWITCH-OVER 
TO SPARE PATH 



-215 



FIG. 4 



71 



APS 
HUB 



65a- 



ATM SF 



-41 



•66a 



ATM PROCESSOR 



/ 
86 



FIG. 5 



-45 



81 

jL 



-b 



\ 
91 



76 





NE CPU 










S 




77a 




77b 



ATM PROCESSOR 



-46 



65b- 



-66b 



ATM SF 



-42 



SUBSTITUTE SHEET (RULE 26) 



WO 00/76147 



PCT/US00/14935 



4/4 



300- 
320 



APS HUB 71 SELECTS WORKING 
AND SPARE ATM PROCESSING CARDS 
45 AND 46 AND INFORM S THEM 

I 



I 



ATM PROCESSOR CARDS 

45 AND 46 INITIATE 
TCP/IP CONNECTIONS TO 
NETWORK ELEMENT CPU 75 



1 



APS HUB READS STATE OF 
ATM PROCESSING CARDS 
45 AND 46 TO ENSURE 
PROPER SELECTION 



-310 



REQUEST DOWNLOAD 




( END ) 



360- 



380- 



DOWNLOAD 
INITIATED 



INFORM 
APS HUB 71 

<T~ 

370 



REPORT ON 
SUCCESS AND 
RESTART CARD 



FIG. 6 




INFORM APS 
HUB 71 OF FAULT 



T 



APS HUB 71 
RETRIEVES ALARM 

i 



INITIATE SWITCH-OVER 
1 



DISCONNECT TCP/IP 
CONNECTIONS AND 

RECONNECT IN 
REVERSED FASHION 

I 



-405 



-410 



-415 



-420 



NEW WORKING ATM 
PROCESSING CARD 
RESTARTS UNI/NNI CALLS 
AND CLEARS SVC E NTRIES 

I 



-425 



NEW WORKING ATM 
PROCESSING CARD ENABLES 
SWITCH PORTS, NEW SPARE 
DISABLES SWITCH PORTS 



-430 



FIG. 7 



SUBSTITUTE SHEET (RULE 261 



INTERNATIONAL SEARCH REPORT 



Interna* il Application No 

PCT/US 00/14935 



A. CLASSIFICATION OF SUBJECT MATTER 

IPC 7 H04L12/56 H04Q11/04 



According to International Patent Gasification (IPC) or to both national classification and IPC 



B. FIELDS SEARCHED 



Minimum documentation searched (classification system followed by classification symbols) 

IPC 7 H04L H04Q 



Documentation searched other than minimum documentation to the extent that such documents are included in the fields searched 



Electronic data base consulted during the international search (name of data base and. where practical, search terms used) 

EPO-Internal , INSPEC, WPI Data 



C. DOCUMENTS CONSIDERED TO BE RELEVANT 



Category p 


Citation of document, with indication, where appropriate, of the relevant passages 


Relevant to dabn No. 


Y 


EP 0 818 940 A (NORTHERN TELECOM LTD) 


1 




14 January 1998 (1998-01-14) 




A 


page 9, line 38 -page 10, line 14; figure 
9 


2-14 


Y 


US 5 781 527 A (TRAUPMAN EDWARD P ET AL) 


1 




14 July 1998 (1998-07-14) 




X 


column 6, line 9 -column 7, line 59 


2,21 


A 


figures 1-3 


3-14,22, 






23 


Y 


US 5 848 227 A (SHEU TSANG-LING) 


15 




8 December 1998 (1998-12-08) 




A 


column 2, line 59 -column 4, line 20; 


10,11, 




figure 2 


16-20 




-/-- 





Further documents are listed in the continuation of box C. 



Patent family members are listed in annex. 



° Special categories of cited documents : 

"A" document defining the general state of the art which is not 
considered to be of particular relevance 

"E* earlier document but published on or after the international 
filing date 

"L" document which may throw doubts on priority claim(s) or 
which is cited to establish the publication date of another 
citation or other special reason (as specified) 

'O' document referring to an oral disclosure, use, exhibition or 
other means 

'P* document published prior to the international filing date but 
later than the priority date daimed 



T" later document published after the international filing date 
or priority date and not in conflict with the application but 
cited to understand the principle or theory underlying the 
invention 

"X" document of particular relevance; the claimed invention 
cannot be considered novel or cannot be considered to 
involve an inventive step when the document is taken alone 

"Y" document of particular relevance; the claimed invention 

cannot be considered to involve an inventive step when the 
document is combined with one or more other such docu- 
ments, such combination being obvious to a person skilled 
in the art 

document member of the same patent famBy 



Date ol the actual completion oi the international search 

27 October 2000 


Date of mailing of the international search report 

06/11/2000 


Name and mailing address of the ISA 

European Patent Office. P.8. 581 8 Patent! a an 2 
NL-2280HV Rijswijk 
Tel. (+01-70) 340-2040. Tx. 31 651 epo nl. 
Fax: (+31-70) 340-3016 


Authorized officer 

Meurisse, W 



Form PCT/tSAtflO {second shoot) (July 1 892) 



page 1 of 2 



INTERNATIONAL SEARCH REPORT 



Internal I Appilcation No 

PCT/US 00/14935 



C(Contlnuatlon) DOCUMENTS CONSIDERED TO 8E RELEVANT 



Category ° Citation of document, w,th indication. where appropriate, of the relevant passages 



Relevant to claim No. 



US 5 884 046 A (ANTONOV VA0IM) 

16 March 1999 (1999-03-16) 

column 5, line 27 - line 45; figure 5 



US 5 671 213 A (KURANO TAKATOSHI) 
23 September 1997 (1997-09-23) 
figures 2,3 

US 5 229 990 A (TERASLINNA KARI T) 
20 July 1993 (1993-07-20) 
figures 1,2 

RATHGEB E P: "REDUNDANCY CONCEPTS FOR A 
LARGE ATM SWITCHING NODE" 
ISS. WORLD TELECOMMUNICATIONS CONGRESS. 
(INTERNATIONAL SWITCHING 
SYMPOSIUM), CA, TORONTO, PINNACLE GROUP, 
21 September 1997 (1997-09-21), pages 
425-433, XP000720548 
the whole document 



15 

10,11, 
16-20 

24 

25-54 
24 

25-54 
55,58 



1-54,56, 
57,59,60 



Form PCT7ISA/210 (contrtuatjon or socond shaet) (J\£y 1992) 



page 2 of 2 



INTERNATIONAL SEARCH REPORT 

ii. ^matlon on patent family members 



Interna it Application No 

PCT/US 00/14935 



Patent document 


Publication 




Patent family 




Publication 


cited in search report 


date 




member(s) 




date 


EP 0818940 A 


14-01-1998 


AU 


685037 


A 


08-01-1998 






CA 


2210121 


A 


11-01-1998 






JP 


10093600 


A 


10-04-1998 



US 5781527 A 14-07-1998 US 6061328 A 09-05-2000 

CA 2199119 A 21-03-1996 

CN 1168752 A 24-12-1997 

EP 0792545 A 03-09-1997 

JP 10505974 T 09-06-1998 

W0 9608902 A 21-03-1996 



US 5848227 A 08-12-1998 US 5781715 A 14-07-1998 

US 5884046 A 16-03-1999 AU 4901797 A 15-05-1998 

W0 9818089 A 30-04-1998 



US 5671213 A 23-09-1997 JP 2655493 B 17-09-1997 

JP 8139726 A 31-05-1996 
CA 2162211 A 05-05-1996 



US 5229990 A 20-07-1993 US 5331631 A 19-07-1994 



Form PCT/1SA/210 (patent tarntyarmx) (July 1592) 



